Information processing apparatus, information processing system, and information processing program

ABSTRACT

A center server is an information processing apparatus communicable with a vehicle including an imaging apparatus and a user terminal of a user of the vehicle. The center server includes a data transmission request unit configured to request the vehicle to transmit imaging data captured by the imaging apparatus when a predetermined request signal is received from the user terminal, and a data transmission unit configured to transmit the imaging data received from the vehicle in response to the request to the user terminal.

INCORPORATION BY REFERENCE

The disclosure of Japanese Patent Application No. 2019-083099 filed onApr. 24, 2019 including the specification, drawings and abstract isincorporated herein by reference in its entirety.

BACKGROUND 1. Technical Field

The disclosure relates to an information processing apparatus, aninformation processing system, and an information processing program.

2. Description of Related Art

Japanese Unexamined Patent Application Publication No. 2006-128807 (JP2006-128807 A) discloses, for example, a technique in which vehicleinformation (for example, information related to forgetting to lock avehicle door) is uploaded from a vehicle to a center or the like whileignition of the vehicle is turned off and the uploaded vehicleinformation can be checked by a user terminal such as a smartphone.

SUMMARY

However, in the related art disclosed in JP 2006-128807 A, for example,imaging data for a user to check a situation of the vehicle or asituation around the vehicle may be uploaded to the center as thevehicle information. Examples of the imaging data include datarepresenting an in-vehicle situation captured by an in-vehicle camera,data representing the situation around the vehicle captured by a cameraoutside vehicle. Since such imaging data has a large data capacity, anamount of data communication when the imaging data as the vehicleinformation is uploaded from the vehicle to the center or the like isrelatively increased. Therefore, there is a concern about an increase incommunication cost or an influence on communication traffic.

The disclosure is to suppress an increase in a communication amount ofdata to be uploaded from a vehicle.

A first aspect of the disclosure relates to an information processingapparatus communicable with a vehicle including an imaging apparatus anda user terminal of a user of the vehicle. The information processingapparatus includes a data transmission request unit configured torequest the vehicle to transmit imaging data captured by the imagingapparatus when a predetermined request signal is received from the userterminal, and a data transmission unit configured to transmit theimaging data received from the vehicle in response to the request to theuser terminal.

According to the embodiment, solely when a center server which is theinformation processing apparatus receives the predetermined requestsignal indicating a transmission request for the imaging data, imagingdata inside and outside the vehicle is uploaded to the center server.Therefore, when the user desires to check a vehicle state (such as doorlock state, hazard lamp state, or the like), the center server does notreceive the predetermined request signal. Therefore, it is possible tosuppress that imaging data having a large data capacity is uploaded tothe center server. For this reason, it is possible for the user to checkspecific vehicle information such as a door lock state while an increasein a communication amount, requested for the uploading, between thein-vehicle device and the center server is suppressed. In addition, itis possible to effectively utilize communication resources bysuppressing an increase in a communication amount between the in-vehicledevice and the center server.

A second aspect of the disclosure relates to an information processingsystem. The information processing system includes the informationprocessing apparatus, and a current shutdown unit which is provided inthe vehicle and configured to shut down current supply from an auxiliarybattery to the imaging apparatus from when ignition off of the vehicleis detected until the request signal is received.

According to the embodiment, an operation of the imaging apparatus afterthe ignition off is suppressed. Therefore, the supply of the darkcurrent from the auxiliary battery to the imaging apparatus iseliminated and thus it is possible to suppress exhaustion of theauxiliary battery.

A third aspect of the disclosure relates to an information processingsystem. The information processing system includes the informationprocessing apparatus, and an operation stop unit which is provided inthe vehicle and configured to stop an operation of the imaging apparatuswhen a charging state of an auxiliary battery that supplies a current tothe imaging apparatus becomes less than a predetermined threshold valuefrom when an ignition off of the vehicle is detected until the requestsignal is received.

According to the embodiment, it is possible to continuously captureimages inside and outside the vehicle for a certain period from when theignition is turned off until the charging state of the auxiliary batteryfalls below a preset threshold value. Therefore, it is possible toprovide the user with the images captured for a certain time after theignition off while the difficulty of the engine start due to theexhaustion of the battery is prevented, and thus the user can leave thevehicle with more easy feeling.

A fourth aspect of the disclosure can be realized as an informationprocessing program.

According to the disclosure, an effect is obtained in which it ispossible to suppress the increase in the communication amount of thedata to be uploaded from the vehicle.

BRIEF DESCRIPTION OF THE DRAWINGS

Features, advantages, and technical and industrial significance ofexemplary embodiments of the disclosure will be described below withreference to the accompanying drawings, in which like signs denote likeelements, and wherein:

FIG. 1 is a diagram showing a configuration example of an informationprocessing system 1 according to an embodiment of the disclosure;

FIG. 2 is a diagram showing a configuration example of a center server10;

FIG. 3 is a table showing an example of a user information DB 131;

FIG. 4 is a table showing examples of a reservation information DB 132;

FIG. 5 is a table showing examples of a use history information DB 133;

FIG. 6 is a diagram showing a configuration example of an in-vehicledevice 200;

FIG. 7 is a diagram showing an example of a vehicle informationacquisition unit 270;

FIG. 8 is a diagram showing a configuration example of a portableterminal 30;

FIG. 9 is a diagram showing an example of a terminal informationacquisition unit 370;

FIG. 10 is a flowchart for describing an operation from when atransmission request for imaging data is generated until an image basedon the imaging data is displayed on the portable terminal 30;

FIG. 11 is a diagram schematically representing a state until atransmission request for imaging data reaches a vehicle;

FIG. 12 is a diagram schematically representing a state until imagingdata reaches the portable terminal 30 in response to a transmissionrequest for imaging data; and

FIG. 13 is a diagram schematically representing a state in which vehicleinformation (vehicle state information) other than imaging data is inputto the portable terminal 30.

DETAILED DESCRIPTION OF EMBODIMENTS

Hereinafter, embodiments of the disclosure will be described withreference to drawings.

EMBODIMENT

FIG. 1 is a diagram showing a configuration example of an informationprocessing system 1 according to the embodiment of the disclosure. Theinformation processing system 1 includes an in-vehicle device 200mounted on a vehicle 20, a portable terminal 30 which is a user terminalowned by a user of a vehicle, and a center server 10 which is aninformation processing apparatus capable of communicating with thein-vehicle device 200 and the portable terminal 30.

The vehicle 20 can perform wireless communication (short-range wirelesscommunication) at a relatively short range with the portable terminal 30in accordance with a predetermined communication standard. The vehicle20 can transmit vehicle information such as position information andimaging data to the center server 10 by being connected to becommunicable with the center server 10 through a predeterminedcommunication network. Hereinafter, the vehicle 20 may be simplyreferred to as “vehicle” or “car”. The vehicle is not limited to apassenger vehicle and may be a freight vehicle, a shared vehicle (forexample, a bus), or the like.

Examples of the predetermined communication network include a mobilecommunication network having a number of base stations as terminals, asatellite communication network using a communication satellite, anInternet network.

Examples of the in-vehicle device 200 include a navigation apparatus, anaudio apparatus, a communication circuit, an inverter, a motorelectronic control unit (ECU), a hybrid ECU, an engine ECU, a motor, andauxiliary machines. The navigation apparatus displays a map and a hostvehicle position on a display using position information and map data byusing a global navigation satellite system (GNSS). The audio apparatusreceives a broadcast radio wave from a radio or a television to output asound or video thereof, reproduces music data stored on a compact disc(CD) or a digital versatile disk (DVD) to output a music thereof, orreceives music data stored in the portable terminal 30 to output a musicthereof from a speaker mounted on the vehicle 20.

The communication circuit performs the short-range wirelesscommunication with the portable terminal 30 compliant with, for example,a Bluetooth (registered trademark) low energy (BLE) communicationstandard. The communication circuit may be communication means capableof performing the short-range communication with the portable terminal30 and is not limited to communication means compliant with the BLEcommunication standard.

For example, a communication channel may be communication meanscompliant with a near field communication standard having a very shortcommunicable distance such as near field communication (NFC), ZigBee(registered trademark), or ultra wide band (UWB). In the case, thecommunication channel may be built in a position close to a body surfaceoutside a vehicle cabin of the vehicle 20 (for example, inside of doorhandle). Accordingly, it is possible to communicate with the portableterminal 30 outside the vehicle cabin using the communication channel.The communication circuit of the in-vehicle device 200 distributes anadvertising packet periodically (for example, every several seconds) toestablish a state in which communication compliant with a predeterminedcommunication standard with the portable terminal 30 is possible. Theadvertising packet includes advertisement information. Examples of theadvertisement information include a universally unique identifier (UUID)and a device ID. The UUID is, for example, an identifier (in-vehicledevice ID) that uniquely identifies the in-vehicle device 200 onsoftware and is information shared by the in-vehicle device 200 and theportable terminal 30. For example, when power of the in-vehicle device200 is turned on, the communication circuit of the in-vehicle device 200transmits an advertising packet which is data including the identifierwith respect to the portable terminal 30. The portable terminal 30 thatreceives the advertising packet checks the UUID or the like included inthe advertising packet to cause the communication circuit of thein-vehicle device 200 to establish the state in which the communicationbetween the portable terminal 30 and the in-vehicle device 200 ispossible.

The auxiliary machines include an air conditioner, a radiator fan, and arear defogger, and the like. The device mounted on the vehicle 20includes various sensors in addition to the above devices. The varioussensors include a voltage sensor that detects a voltage input from astorage battery to the inverter, a voltage sensor that detects a voltageinput from the inverter to the motor, a speed sensor that detects avehicle speed, an accelerator sensor that detects an acceleratoroperation amount, a brake sensor that detects a brake operation amount,and the like.

The portable terminal 30 is a portable terminal that can be carried byan occupant (a driver, a passenger, or the like) of the vehicle 20. Theportable terminal 30 is a cellular phone, a smartphone, a notebookcomputer, a personal handy-phone system (PHS), or the like. The portableterminal 30 communicates with the center server 10 through apredetermined communication network compliant with wirelesscommunication standards such as global system for mobile communications(GSM: registered trademark), personal digital cellular (PDC), codedivision multiple access (CDMA), long term evolution (LTE), worldwideinteroperability for microwave access (WiMAX), and the like. The“occupant” is also a user of the portable terminal 30 and thus may bereferred to as a “user”. Details of communication contents between thecenter server 10 and the portable terminal 30 will be described below.The portable terminal 30 can also perform the short-range wirelesscommunication with the in-vehicle device 200 of the vehicle 20 inaccordance with the wireless communication standard. The short-rangewireless communication includes Bluetooth, wireless LAN (local areanetwork), and the like.

The center server 10 is a server that provides various services.Examples of the various services include a car sharing service, anauthentication key service, a trunk delivery service, and a B2C carsharing service.

FIG. 2 is a diagram showing a configuration example of the center server10. The center server 10 includes a controller 110, a communicationprocessing unit 120, a storing unit 130, and a bus line 140. Thecontroller 110, the communication processing unit 120, and the storingunit 130 are connected to be communicable with each other through thebus line 140. FIG. 2 illustrates a function of the controller 110 andstored information of the storing unit 130 when the center server 10 isa server that provides the car sharing service, for example.

The controller 110 includes a reservation management unit 111, a usefrequency determination unit 112, a vehicle type function differenceextraction unit 113, a contact detector 118, a sound pressure leveldetector 119, and a user specification unit 121. The controller 110includes a data transmission request unit 126 and a data transmissionunit 127. The controller 110 includes a central processing unit (CPU), aread only memory (ROM), a random access memory (RAM), and an input andoutput interface (not shown). The CPU is a processor that controls theoverall operation of the center server 10. The ROM stores a dedicatedprogram for realizing functions of the center server 10 (reservationmanagement unit 111, use frequency determination unit 112, vehicle typefunction difference extraction unit 113, contact detector 118, soundpressure level detector 119, user specification unit 121, datatransmission request unit. 126, and the data transmission unit 127). TheRAM is a memory used as a work area for the CPU. When the power isturned on, the CPU executes the dedicated program recorded in the ROM torealize various functions.

The reservation management unit 111 receives a reservation for the useof a vehicle from the user through the portable terminal 30.

The use frequency determination unit 112 determines a use frequency of auser for a vehicle type reserved by the user.

The vehicle type function difference extraction unit 113 extracts afunction having the same function but different operation methodsbetween the vehicle type reserved by the user and a vehicle typefrequently used by the user and the operation methods thereof.

The contact detector 118 receives distance information indicating adistance value measured by a distance measurement unit described belowto determine whether or not a distance from the vehicle to an objectexisting around the vehicle becomes zero based on the distanceinformation. The object is a building or the like existing around thevehicle 20. The building refers to a building having a roof and a pillaror a wall, such as a house, a warehouse, a gate, and a wall, amongconstructions that settle on the land, a gate, a fence, or the likeattached to the building, and a building facility. The object existingaround the vehicle 20 may be any object that may cause damage to thebody surface or a bottom surface of the vehicle 20 and is not limited tothe above. Hereinafter, the “object existing around the vehicle” may besimply referred to as “object”.

When determination is made that the distance from the vehicle to theobject is zero, the contact detector 118 detects the contact of thevehicle with the object when a determination result input from the soundpressure level detector 119 (determination information indicating thatsound pressure level exceeds predetermined threshold value) is input.The user specification unit 121 receives the detection result which isinformation indicating that the contact of the vehicle with the objectis detected.

The sound pressure level detector 119 receives sound informationtransmitted from a sound collection unit described below to calculate asound pressure level representing strength of the sound based on thesound information. Specifically, the sound pressure level detector 119calculates any one of an absolute value of maximum amplitude in thesound information, an absolute value of average amplitude in the soundinformation, a maximum root mean square value of amplitude in the soundinformation, or a root mean square value of the amplitude in the soundinformation and calculates the calculated value as the sound pressurelevel.

The sound pressure level detector 119 determines whether or not thecalculated sound pressure level exceeds a predetermined threshold valueand inputs a determination result indicating that the sound pressurelevel exceeds the predetermined threshold to the contact detector 118when determination is made that the sound pressure level exceeds thepredetermined threshold.

When contact is detected by the contact detector 118, the userspecification unit 121 specifies a user of a vehicle from which thecontact is detected based on user identification information which isinformation for identifying the user of the vehicle. The useridentification information is a user ID to be stored in a userinformation DB 131.

The user specification unit 121 generates table information and storesthe generated table information in a user specifying information storageunit 137. The table information is, for example, information in whichtime point information at which the contact is detected is associatedwith user specifying information which is information representing theuser of the vehicle from which the contact is detected. The associationof the time point at which the contact is detected with the userspecifying information enables an administrator of the car sharingservice or a car rental service to easily specify a user who drives thevehicle when the contact occurs by checking a time point stored in theuser specifying information storage unit 137 and also leads toprevention of false charge for users other than the user, even when aspecific vehicle is used by a plurality of different users during a day.The table information is not limited to the above, for example, may beinformation in which solely user specifying information is recorded inorder of time series with no association of the time point with the userspecifying information. Even with the table information generated inthis manner, it is possible to roughly specify the user who drives thevehicle when the contact occurs by checking a use history of thevehicle.

The information processing system 1 according to the embodiment may beconfigured to display the user specifying information on, for example, ascreen (display unit 340) of the portable terminal owned by theadministrator of the car sharing service or a screen of the terminaldevice of the car sharing service. In the case, the user specifyinginformation may be stored in the user specifying information storageunit 137 or may be solely displayed on the portable terminal withoutbeing stored in the user specifying information storage unit 137. Thisis because it is possible to discriminate the user of the vehicle whenthe contact occurs solely by the display of the user specifyinginformation and to suppress an increase in a memory capacity of the userspecifying information storage unit 137.

When a predetermined request (imaging data transmission request) signalfrom the portable terminal 30 is received through the communicationprocessing unit 120, the data transmission request unit 126 requeststransmission of imaging data captured by an imaging apparatus(corresponding to an imaging unit 430 provided in the in-vehicle device200) with respect to the in-vehicle device 200. The request signal istransmitted to the in-vehicle device 200 through the communicationprocessing unit 120.

The imaging data transmitted from the in-vehicle device 200 is input tothe data transmission unit 127 through the communication processing unit120 in response to the imaging data transmission request from the datatransmission request unit 126.

The data transmission unit 127 transmits (relays) the input imaging datato the portable terminal 30. In the portable terminal 30 that receivesthe imaging data, an image based on the imaging data is displayed on ascreen of a dedicated application installed in the portable terminal 30.The image is an image inside the vehicle, an image near a vehicle body,an image around the outside of the vehicle, or the like.

The data transmission unit 127 may store the input imaging data in animaging data storage unit 134 of the storing unit 130 simultaneouslywith transmitting the input imaging data to the portable terminal 30.The data transmission unit 127 may temporarily store the input imagingdata in a buffer provided in the data transmission unit 127simultaneously with transmitting the input imaging data to the portableterminal 30.

As described above, with the storing of the imaging data in the imagingdata storage unit 134, the data transmission unit 127 can read out andtransmit again the imaging data stored in the imaging data storage unit134 when a retransmission request is received from the portable terminal30 or when a response from the portable terminal 30 with respect to thereception of the imaging data does not reach a certain time, forexample, even when a communication failure occurs between the centerserver 10 and the portable terminal 30. Accordingly, it is possible toreliably input the imaging data into the portable terminal 30, and thususer convenience is further improved.

The communication processing unit 120 transmits and receives data by thewireless communication. The communication processing unit 120 performscommunication between the vehicle and the portable terminal 30.

The storing unit 130 stores information used by the controller 110. Thestoring unit 130 includes the user information DB 131, a reservationinformation DB 132, a use history information DB 133, the imaging datastorage unit 134, and the user specifying information storage unit 137.

FIG. 3 is a table showing an example of the user information DB 131. Theuser information DB 131 stores a user ID, a password, a vehicle type ofa private vehicle, and the like for each user. The private vehicle is avehicle owned by a user and is a vehicle that the user usually uses.That is, the private vehicle is a vehicle frequently used by the user.In the user information DB 131, a user name, the user ID, the password,the vehicle type of the private vehicle, and the like are stored inassociation with the user.

The data to be stored in the user information DB 131 may be data inputusing the dedicated application installed in the portable terminal 30,for example. In the case, the data received by the portable terminal 30is transmitted to the center server 10 from the portable terminal 30.The data to be stored in the user information DB 131 may be data inputto a terminal device of a store that sells the private vehicle. In thecase, the data received by the terminal device of the store istransmitted to the center server 10 from the terminal device of thestore.

FIG. 4 is a table showing examples of the reservation information DB132. The reservation information DB 132 stores reservation informationfor each of a plurality of vehicles. FIG. 4 shows reservationinformation for a vehicle A (vehicle type a) and reservation informationfor three vehicles other than the vehicle A. The reservation informationincludes a rental date and time of the vehicle, a rental place, a returndate and time, a return place, a user name who reserves the vehicle, andthe like. The reservation information DB 132 stores the vehicle rentaldate and time, the rental place, the return date and time, the returnplace, and the like in association with the user name who reserves thevehicle. The information to be stored in the reservation information DB132 is not limited to the above information, and the reservationinformation DB 132 may include, for example, an e-mail address of theportable terminal 30 owned by the user who reserves the vehicle.

FIG. 5 is a table showing examples of the use history information DB133. The use history information DB 133 stores use history informationof each of a plurality of users. FIG. 5 shows use history information ofa user AAA and use history information of three users other than theuser AAA. The use history information DB 133 stores a vehicle type usedby the user in the past, a use start date and time, a use end date andtime, and the like in association with a user name who uses the vehicle.The number of uses of the vehicle type may be calculated by the userbased on the use history information DB 133. The information to bestored in the use history information DB 133 is not limited to the aboveinformation, and the use history information DB 133 may include, forexample, information on the number of uses of each of a plurality ofvehicle types.

Next, a configuration of the in-vehicle device 200 will be describedwith reference to FIG. 6 and the like. FIG. 6 is a diagram showing aconfiguration example of the in-vehicle device 200. The in-vehicledevice 200 includes an ECU 210, a communication processing unit 220, astoring unit 230, a display unit 240, an sound output unit 250, anoperation input unit 260, a vehicle information acquisition unit 270, anin-vehicle network 280 based on a communication protocol such ascontroller area network (CAN), a distance measurement unit 400, a soundcollection unit 410, and the imaging unit 430.

The ECU 210, the communication processing unit 220, the storing unit230, the display unit 240, the sound output unit 250, the operationinput unit 260, the vehicle information acquisition unit 270, thedistance measurement unit 400, the sound collection unit 410, and theimaging unit 430 are connected to be communicable with each otherthrough the in-vehicle network 280.

The ECU 210 includes a CPU, a ROM, a RAM, and an input and outputinterface (not shown). The CPU is a processor that controls the overalloperation of the in-vehicle device 200. The ROM stores a dedicatedprogram for realizing functions of the in-vehicle device 200 (thevehicle type information acquisition processing unit 211, the vehicleinformation transmission unit 213, and the imaging unit operationcontroller 214). The RAM is a memory used as a work area for the CPU.When the power is turned on, the CPU executes the dedicated programrecorded in the ROM to realize various functions.

The vehicle type information acquisition processing unit 211 acquiresinformation on operation methods that are different from each other foreach function of a vehicle type frequently used by the user, from thecenter server 10 or the portable terminal 30. The vehicle typeinformation acquisition processing unit 211 stores the acquiredinformation in an operation method difference information DB 231.

The vehicle information transmission unit 213 includes a stateinformation transmission unit 213 a and an imaging informationtransmission unit 213 b, and transmits vehicle information to the centerserver 10 when a request from the center server 10 is input through thecommunication processing unit 220. Examples of the vehicle informationinclude information related to a state of the vehicle 20 and imagingdata.

When a transmission request for the information related to the state ofthe vehicle 20 is received, the state information transmission unit 213a of the vehicle information transmission unit 213 transmits theinformation related to the state of the vehicle 20 acquired by thevehicle information acquisition unit 270 to the center server 10 throughthe communication processing unit 220, for example.

The information related to the state of the vehicle 20 includesdetection information detected by the various sensors. The detectioninformation includes a temperature around an engine, informationindicating a lock state (locked or unlocked) of the vehicle door, andinformation indicating a light-on state (light-on or light-off) of ahazard lamp, and is acquired (collected) by the vehicle informationacquisition unit 270.

For example, even when the user forgets to lock the vehicle door afterthe ignition of the vehicle is turned off, the information related tothe state of the vehicle 20 (vehicle information) is transmitted to theportable terminal 30 through the center server 10, for example, when thededicated application installed on the portable terminal 30 is activatedand performs the transmission request for the information related to thestate of the vehicle 20. Accordingly, it is possible for the user tocheck the lock state of the vehicle door through an icon on a screenactivated by the dedicated application of the portable terminal 30. Adisplay example of the icon will be described below.

Similarly, even when the user forgets to turn off the hazard lamp afterthe ignition of the vehicle is turned off, it is possible for the userto check a state of the hazard lamp through the icon on the screenactivated by the dedicated application of the portable terminal 30, forexample, when the dedicated application performs the transmissionrequest for the information related to the state of the vehicle 20.

It is also possible to remotely operate some functions of the vehicle byoperating icons on the screen of the dedicated application by the user.For example, when a door icon (for example, a figure that can selectwhether to lock or unlock the vehicle door) is operated, the vehiclereceives a door lock command from the portable terminal 30 through thecenter server 10. Accordingly, it is possible to remotely lock thevehicle door.

When a hazard icon (for example, a figure that can select whether toturn the light on or off the hazard lamp) is operated, the vehiclereceives a hazard lamp turn-off command from the portable terminal 30through the center server 10. Accordingly, it is possible to remotelyturn off the hazard lamp.

A technique for remotely operating the vehicle with the portableterminal 30 is disclosed in, for example, Japanese Unexamined PatentApplication Publication No. 2018-204472 (JP 2018-204472 A). Therefore, adetailed description thereof is omitted.

When a transmission request for the imaging data is received, theimaging information transmission unit 213 b of the vehicle informationtransmission unit 213 transmits imaging data captured by the imagingunit 430 or imaging data stored in an imaging information storage unit235 to the center server 10 through the communication processing unit220. The imaging information transmission unit 213 b may temporarilyread the imaging data captured by the imaging unit 430 or the imagingdata stored in the imaging information storage unit 235 and thentransmit the imaging data to the center server 10 through thecommunication processing unit 220. Alternatively, the imaging unit 430may be requested to transmit the imaging data to the center server 10through the communication processing unit 220.

For example, even when the user leaves the vehicle after the ignition ofthe vehicle is turned off, the imaging data is transmitted to theportable terminal 30, for example, when the dedicated applicationinstalled in the portable terminal 30 is activated and performs thetransmission request for the imaging data. Accordingly, it is possiblefor the user to check an image captured by the imaging unit 430 throughthe screen activated by the dedicated application of the portableterminal 30.

When the transmission request for the imaging data is performed, acamera icon on the screen activated by the dedicated application of theportable terminal 30 (for example, a figure that receives a useroperation to display a captured image on the display unit 340 of theportable terminal 30) is operated.

In this manner, with the imaging information transmission unit 213 b ofthe vehicle information transmission unit 213, it is possible for theuser who leaves the vehicle to check whether there is a suspiciousperson near the vehicle, whether a valuable is left behind in thevehicle, weather states (including snowfall state and rainfall state)around the vehicle, and the like, through the display unit 340 of theportable terminal.

The communication processing unit 220 is a communication module basedon, for example, a data communication module (DCM) which is anin-vehicle communication standard, worldwide interoperability formicrowave access (WiMAX) which is the wireless communication standard.The communication processing unit 220 can perform bidirectionalcommunication with the center server 10 and the portable terminal 30through a predetermined communication network.

For example, when the ignition off is detected based on the vehicleinformation, the imaging unit operation controller (current shutdownunit) 214 shuts down supply of a dark current from an auxiliary batteryto the imaging unit 430 from when the ignition off is detected until thecommunication processing unit 220 receives the imaging data transmissionrequest to stop the operation of the imaging unit 430.

The imaging unit operation controller 214 stops the operation of theimaging unit 430, then monitors whether or not the communicationprocessing unit 220 receives the imaging data transmission request. Whenthe imaging data transmission request is received, the imaging unitoperation controller 214 restarts the supply of the dark current fromthe auxiliary battery to the imaging unit 430 in order to activate theimaging unit 430.

Power consumption of the imaging unit 430 after the ignition off is in arange from several [W] to several tens [W] depending on a specificationof the imaging unit 430, a monitoring mode, and the like. Therefore,when the imaging unit 430 operates continuously after the ignition off,the engine may be difficult to start due to auxiliary battery exhaustioncaused by the dark current (discharge current when the system is off)supplied from the auxiliary battery to the imaging unit 430.

The operation of the imaging unit 430 after the ignition off issuppressed by providing the imaging unit operation controller 214.Therefore, the supply of the dark current from the auxiliary battery tothe imaging unit 430 is eliminated and thus it is possible to suppressthe exhaustion of the auxiliary battery.

The configuration example of the imaging unit operation controller 214is not limited thereto. For example, the imaging unit operationcontroller 214 may be configured as an operation stop unit. In the case,the imaging unit operation controller 214 monitors a charging state(SOC) of the auxiliary battery after the ignition off. When the chargingstate of the auxiliary battery is less than a preset threshold value(for example, any value from 15% to 30%), the imaging unit operationcontroller 214 stops the operation of the imaging unit 430 to shut downthe supply of the dark current from the auxiliary battery to the imagingunit 430.

The SOC of the auxiliary battery varies depending on use states of thevehicle (previous traveling distance and traveling situation of thevehicle, elapsed time from the previous ignition off, and the like).Therefore, the threshold value may be set as a value derived by asimulation or the like in advance in view of these variation conditionsor may be a value obtained by performing machine learning in thein-vehicle device 200.

With the above configuration, it is possible to record a certain period(for example, from several hours to several tens of hours) from when theignition is turned off until the charging state of the auxiliary batteryfalls below the preset threshold value in the imaging informationstorage unit 235 by continuously capturing the images inside and outsidethe vehicle. For this reason, it is possible to provide the user withthe images captured for a certain time after the ignition off while thedifficulty of the engine start due to the exhaustion of the battery isprevented, and thus the user can leave the vehicle with more easyfeeling.

The storing unit 230 stores information used by the ECU 210 and thelike. The storing unit 230 includes the operation method differenceinformation DB 231, a reservation information DB 232, a map informationDB 233, a function information DB 234, and the imaging informationstorage unit 235.

The distance measurement unit 400 is a sensor that measures a distancefrom the vehicle to the object existing around the vehicle. The distancemeasurement unit 400 is, for example, a clearance sonar or a radarsensor.

For example, the clearance sonar is provided on the right and left sidesof a front portion of the vehicle, respectively and further provided oneach of the right and left sides of a rear portion of the vehicle,respectively. The clearance sonar transmits an ultrasonic wave to afront side or rear side of the vehicle, detects the object existingaround the vehicle based on a reflected wave of the ultrasonic wave, andoutputs sonar information according to the detection result. The sonarinformation includes information representing a distance from a currentposition of the vehicle to an installation position of the object.

The radar sensor is provided on the front portion and rear portion ofthe vehicle, respectively. The radar sensor transmits a detection waveother than the ultrasonic wave (for example, an electromagnetic wavesuch as a millimeter wave or a laser) to the front side or rear side ofthe vehicle and detects the object existing around the vehicle based ona reflected wave. When a laser is used, the radar sensor is, forexample, laser imaging detection and ranging (LIDAR). The radar sensoroutputs radar information according to a detection result of anobstacle. The radar information includes information representing thedistance from the current position of the vehicle to the installationposition of the object, information representing a relative speedbetween the vehicle and the object, and the like.

The sound collection unit 410 is a sound detection microphone thatcollects a sound around the vehicle, detects the sound as a vibrationwaveform, and inputs a signal indicating the detected vibration waveformto the sound pressure level detector 119 of the center server 10 as thesound information. The sound around the vehicle is a sound generatedwhen the vehicle lightly touches or makes a rear-end collision with theobject existing around the vehicle. The sound information is input fromthe in-vehicle device 200 of the vehicle to the sound pressure leveldetector 119 through the communication processing unit 120 and the busline 140 of the center server 10.

The operation method difference information DB 231 stores theinformation on the operation methods that are different from each otherfor each function of the vehicle type frequently used by the user. Anoperation method having a high priority is preferentially guided whenthe function operation method is guided. The priority may be determinedin advance in the function information DB 234. The operation methoddifference information DB 231 may store information on the mutually sameoperation method for each function of the vehicle type frequently usedby the user.

The map information DB 233 stores map information used when thein-vehicle device 200 provides route guidance. The map informationincludes information such as a road and a facility.

The function information DB 234 stores information such as a vehiclestate when each function of the vehicle is used. Examples of the vehiclestate include “engine is started”, “current position is a gas stationand vehicle is stopped”, and “shift lever is in a reverse mode”. In thefunction information DB 234, the vehicle state and the function of thevehicle to be used in the state are stored in association with eachother. In the function information DB 234, a vehicle operation methodand a vehicle state are stored in association with each of a pluralityof functions. In the function information DB 234, information such as aplurality of states may be stored for one function. The functioninformation DB 234 may have priority information for each function.

The imaging information storage unit 235 stores imaging information. Theimaging information includes imaging data captured by the imaging unit430, time point information indicating a time point when the imagingdata is generated, and the like. The imaging data is image data insidethe vehicle, image data near the vehicle body, image data around thevehicle, and the like.

The display unit 240 performs a display based on display screen datatransmitted from the ECU 210 or the like. The display unit 240 is adisplay device such as a liquid crystal display (LCD) or an organicelectroluminescence (EL) display.

The sound output unit 250 performs sound output based on sound datatransmitted from the ECU 210 or the like. The sound output unit 250 is,for example, a speaker.

The operation input unit 260 receives a command for the in-vehicledevice 200 from the user. The operation input unit 260 is, for example,various switches, a touch sensor, a sound input apparatus, or the like.

The vehicle information acquisition unit 270 acquires information on thevehicle state and the like from a sensor or the like of each portion ofthe vehicle. A configuration example of the vehicle informationacquisition unit 270 will be described with reference to FIG. 7.

FIG. 7 is a diagram showing an example of the vehicle informationacquisition unit 270. In the example in FIG. 7, the vehicle informationacquisition unit 270 includes a steering detector 271, a brake detector272, a reverse detector 273, a GPS information receiver 274, a vehiclespeed detector 275, and an engine detector 277. The vehicle informationacquisition unit 270 may include another detector, a sensor, or thelike. The vehicle information acquisition unit 270 may include, forexample, a fuel sensor, a water temperature sensor, a rain sensor, aroad surface sensor, a visibility sensor, an atmospheric pressuresensor, and a light and darkness sensor.

The steering detector 271 detects a steering pulse signal generatedaccording to a steering rotation angle. The steering detector 271transmits the detected steering pulse signal to the ECU 210. Thesteering pulse signal detected by the steering detector 271 is output,for example, every time the steering rotates by a predetermined angle.The steering detector 271 electrically detects the steering pulse signalthrough a terminal.

The brake detector 272 detects whether or not a vehicle parking brake isapplied. The brake detector 272 notifies the ECU 210 of the detectionresult. The brake detector 272 detects whether or not the parking brakeis applied, for example, based on a conduction state of a switch that isturned on and off in conjunction with a movement of a parking brakelever (or parking brake pedal). For example, the brake detector 272electrically detects the conduction state of the switch through theterminal.

The reverse detector 273 detects whether or not the shift lever of thevehicle is in the reverse mode. The reverse detector 273 notifies theECU 210 of the detection result. For example, the reverse detector 273detects whether or not the shift lever is in the reverse mode based onthe conduction state of a switch that is turned on and off inconjunction with the shift lever. For example, the reverse detector 273electrically detects the conduction state of the switch through theterminal.

The GPS information receiver 274 receives a radio wave signal from a GPSsatellite received by a global positioning system (GPS) antennaconnected to the terminal and transmits the received signal to the ECU210. The GPS is a system that measures a position of the GPS antennabased on radio waves from at least three GPS satellites out of many GPSartificial satellites that orbit the earth.

Here, a positioning system using GPS is adapted as the GNSS. However,the GNSS is not limited to the GPS, and a positioning system using asatellite such as Galileo or global navigation satellite system(GLONASS) may be used. The GNSS is a positioning system in which apositioning apparatus mounted on a moving body measures a position ofthe moving body using the signals from the satellites.

The vehicle speed detector 275 detects a vehicle speed pulse signalgenerated according to a rotation angle of an axle. The vehicle speeddetector 275 transmits the detected vehicle speed pulse signal to theECU 210. The vehicle speed pulse signal detected by the vehicle speeddetector 275 is a step-like pulse signal output from the vehicle speedsensor or an electronic control unit that controls the vehicle engine orbrake. The vehicle speed pulse signal is output, for example, every timethe axle rotates by a predetermined angle. A relationship between thevehicle speed pulse signal and a movement distance of the vehiclechanges depending on a manufacturer of a vehicle, a vehicle type, a sizeof a wheel mounted on the vehicle, an air pressure, and the like. Forthis reason, the ECU 210 may correct as appropriate the vehicle speed bythe detected vehicle speed pulse signal detected based on the movementdistance of the vehicle calculated based on the positioning result byGPS. The vehicle speed detector 275 electrically detects the vehiclespeed pulse signal through the terminal.

The engine detector 277 detects whether or not the engine is driven. Theengine detector notifies ECU 210 of the detection result. For example,the engine detector 277 detects whether or not the engine is driven bythe conduction state of a switch that is turned on and off inconjunction with an engine rotation. The engine detector 277electrically detects the conduction state of the switch through theterminal.

Returning to FIG. 6, the imaging unit 430 is an omnidirectional camera,a panorama camera, or the like that captures images of the entireinterior of the vehicle, scenery near an outer peripheral portion of thevehicle, and the like. An example of the imaging unit 430 includes animaging element such as a charge-coupled device (CCD) or a complementarymetal oxide-semiconductor (CMOS). The scenery near the outer peripheralportion of the vehicle is a scene of a front end portion of the vehicle(for example, outer peripheral surface of front bumper) and surroundingsof the front end portion, a scene of a rear end portion of the vehicle(for example, outer peripheral surface of rear bumper) and surroundingsof the rear end portion, and the like. The scenery near the outerperipheral portion of the vehicle may include a scene outside thevehicle in a vehicle width direction.

Next, a configuration of the portable terminal 30 will be described withreference to FIG. 8. FIG. 8 is a diagram showing a configuration exampleof the portable terminal 30. The portable terminal 30 includes acontroller 310, a communication processing unit 320, a storing unit 330,a display unit 340, a sound output unit 350, an input unit 360, aterminal information acquisition unit 370, and a bus line 380. Thecontroller 310, the communication processing unit 320, the storing unit330, the display unit 340, the sound output unit 350, the input unit360, and the terminal information acquisition unit 370 are connected tobe communicable with each other through the bus line 380.

The controller 310 includes a CPU, a ROM, a RAM, and an input and outputinterface (not shown). The CPU is a processor that controls the overalloperation of the portable terminal 30. The ROM stores a dedicatedprogram for realizing functions of the portable terminal 30 (reservationprocessing unit 311, vehicle type information acquisition processingunit 312, scene determination unit 313, UI application 314). The RAM isa memory used as a work area for the CPU. When the power is turned on,the CPU executes the dedicated program recorded in the ROM to realizevarious functions.

The reservation processing unit 311 receives a vehicle use reservationfrom the user and performs a user vehicle use reservation processingwith respect to the center server 10.

The vehicle type information acquisition processing unit 312 receivesthe function operation method of the vehicle from the center server 10and stores the method in the vehicle type information DB 332.

The scene determination unit 313 determines the vehicle state and thelike according to information (position information and accelerationinformation) from the terminal information acquisition unit 370 or thelike, the map information, or the like. The scene determination unit 313guides an appropriate function operation method according to the vehiclestate through the display unit 340 and the sound output unit 350.

The UI application 314 includes an application program capable ofperforming an operation by the user of the portable terminal 30, thededicated application described above, and the like. The dedicatedapplication is installed to configure a request unit 314 a thatgenerates a request signal for requesting provision of imaging data, anoperation unit 314 b that generates an operation command for remotelyoperating the in-vehicle device 200, an icon display unit 314 c thatdisplays a predetermined icon on a screen of the dedicated application,an image display unit 314 d that displays an image captured by theimaging unit 430 on the display unit 340 of the portable terminal 30based on the imaging data transmitted from the in-vehicle device 200.

The communication processing unit 320 transmits and receives data by thewireless communication. The communication processing unit 320 performscommunication between the center server 10 and the vehicle. Thecommunication processing unit 320 may transmit and receive data by wiredcommunication. For example, the communication processing unit 320 may beconnected to the vehicle by wire to transmit and receive the data.

The storing unit 330 stores information used by the controller 310. Thestoring unit 330 includes a reservation information DB 331, the vehicletype information DB 332, and a map information DB 333.

The reservation information DB 331 stores reservation informationincluded in reservation completion notification received from the centerserver 10.

The vehicle type information DB 332 stores the vehicle type reserved bythe user and the vehicle type frequently used by the user. The vehicletype information DB 332 may store a function operation method for eachvehicle type. The function operation method for each vehicle type isacquired from the center server 10, for example.

The map information DB 333 stores the map information used for the routeguidance or the like. The map information includes information such as aroad and a facility.

The display unit 340 performs a display based on display screen datatransmitted from the controller 310 or the like. The display unit 340 isa display device such as the LCD or the organic EL display.

The sound output unit 350 performs sound output based on sound datatransmitted from the controller 310 or the like. The sound output unit350 is, for example, a speaker.

The input unit 360 receives a command from the user. The input unit 360is, for example, various switches, a touch sensor, a sound inputapparatus, or the like.

The terminal information acquisition unit 370 acquires informationrelated to a portable terminal state and the like from a sensor or thelike of each portion of the portable terminal 30. A configuration of theterminal information acquisition unit 370 will be described withreference to FIG. 9.

FIG. 9 is a diagram showing an example of the terminal informationacquisition unit 370. The terminal information acquisition unit 370includes a GPS information receiver 371 and an acceleration detector372. The terminal information acquisition unit 370 may include anotherdetector, a sensor, or the like.

The GPS information receiver 371 receives a radio wave signal from a GPSsatellite received by a GPS antenna connected to a terminal andtransmits the received signal to the controller 310. The GNSS is notlimited to the GPS, and the positioning system using the satellite suchas Galileo or GLONASS may be used.

The acceleration detector 372 detects an acceleration pulse signalgenerated according to acceleration of the portable terminal 30. Theacceleration detector 372 transmits the detected acceleration pulsesignal to the controller 310. The acceleration pulse signal detected bythe acceleration detector 372 is a pulse signal output from anacceleration sensor or the like. The acceleration of the portableterminal 30 is calculated from the acceleration pulse signal. When theacceleration is calculated, a movement speed and movement distance ofthe portable terminal 30 are calculated. The acceleration, movementspeed, and movement distance of the portable terminal 30 in the vehiclecan be regarded as the same as the acceleration, movement speed, andmovement distance of the vehicle unless the portable terminal 30 ismoved vigorously in the vehicle. The controller 310 may correct asappropriate the acceleration by the detected acceleration pulse signalbased on the movement distance of the portable terminal 30 calculatedbased on the positioning result by GPS. The acceleration detector 372electrically detects the acceleration pulse signal through the terminal.

Next, an operation for transmitting the imaging data to the portableterminal 30 will be described with reference to FIGS. 10 to 13. FIG. 10is a flowchart for describing an operation from when the transmissionrequest for the imaging data is generated until an image based on theimaging data is displayed on the portable terminal 30. FIG. 11 is adiagram schematically representing a state until the transmissionrequest for the imaging data reaches the vehicle. FIG. 12 is a diagramschematically representing a state until the imaging data reaches theportable terminal 30 in response to the transmission request for theimaging data. FIG. 13 is a diagram schematically representing a state inwhich vehicle information (vehicle state information) other than theimaging data is input to the portable terminal 30.

When the user performs an operation for activating the application inorder to display the screen of the dedicated application on the displayunit of the portable terminal 30, the application screen is displayed onthe portable terminal 30 (step S1). Thereafter, when the camera icon tobe displayed on the screen is, for example, touched as shown in FIG. 11(step S2), a transmission request signal for the imaging data isgenerated by the controller 310 and is transmitted to the center server10 (step S3).

When the request signal is received (step S4), the data transmissionrequest unit 126 of the center server 10 transfers the request signal tothe vehicle 20 (step S5).

When the request signal is received (step S6), the vehicle informationtransmission unit 213 of the vehicle 20 reads the imaging data generatedby the imaging unit 430 (step S7) and transmits the data to the centerserver 10 (step S8).

After step S8, the data transmission unit 127 transfers the receivedimaging data to the portable terminal 30 (step S9). When the imagingdata is received (step S10), the controller 310 of the portable terminal30 displays the image based on the imaging data on the screen of thededicated application as shown in FIG. 12 (step S11). Accordingly, it ispossible for the user to check situations inside and outside the vehiclewith the image based on the imaging data.

In step S7, the vehicle information transmission unit 213 of the vehicle20 may read the imaging data from the imaging unit 430 in real time, ormay read out, for example, imaging data at a specific time point or timezone set on the screen of the dedicated application or imaging datacorresponding to a time point indicated by time point data by referringto the time point data recorded in the imaging information storage unit235 from the imaging information storage unit 235.

For example, a time point two hours before a current time point isdesignated on the screen of the dedicated application to enable a stillimage based on imaging data captured at a specific time point two hoursbefore to be reproduced. Accordingly, it is possible for the user tocheck the images inside and outside the vehicle based on the imagingdata at any time point while an increase in a data reception amount issuppressed.

In addition, a time zone from two hours before a current time point totwo hours and ten minutes before the current time point is designated onthe screen of the dedicated application to enable a moving image basedon imaging data captured in the time zone to be reproduced. Accordingly,it is possible for the user to check the detailed images inside andoutside the vehicle based on the imaging data in any time zone.

FIG. 13 describes information (vehicle state information) to betransmitted from the vehicle when the above door icon, hazard icon, orthe like is operated.

In a case where the door icon in FIG. 13 is, for example, in an “UNLOCK”state based on the vehicle state information, when a region marked“LOCK” of the door icon is touched, the vehicle receives the door lockcommand from the portable terminal 30 through the center server 10.Accordingly, it is possible to remotely lock the vehicle door.

In a case where the hazard icon in FIG. 13 is in an “ON” state (light-onstate) based on the vehicle state information, when a region marked“OFF” of the hazard icon is touched, the vehicle receives a hazard-offcommand from the portable terminal 30 through the center server 10.Accordingly, it is possible to remotely turn off the hazard lamp.

As shown in FIG. 13, when the door lock command or the like forrequesting transmission of the vehicle state information is transmitted,the transmission request signal for the imaging data described above isnot transmitted. Therefore, a communication amount when data is uploadedfrom the vehicle to the center server 10 is smaller than a case wherethe imaging data of a still image or a moving image is transmitted. Thesame applies to a communication amount when data is downloaded to theportable terminal 30.

As described above, the center server 10 which is the informationprocessing apparatus according to the embodiment is an informationprocessing apparatus capable of performing communication between avehicle including an imaging apparatus and a user terminal of a vehicleuser. The center server 10 includes a data transmission request unitthat requests the vehicle to transmit imaging data captured by theimaging apparatus when a predetermined request signal is received fromthe user terminal, and a data transmission unit that transmits theimaging data received from the vehicle in response to the request to theuser terminal.

With the above configuration, solely when the center server 10 receivesa predetermined request signal indicating a transmission request for theimaging data, imaging data inside and outside the vehicle is uploaded tothe center server 10, and the imaging data inside and outside thevehicle is downloaded to the portable terminal 30. Therefore, forexample, when the user desires to check a vehicle state (door lockstate, hazard lamp state, or the like) instead of states inside andoutside the vehicle, it is possible to suppress that the imaging datahaving a large data capacity is uploaded to the center server 10 sincethe center server 10 does not receive the predetermined request signal.

For this reason, it is possible for the user to check specific vehicleinformation such as the door lock state and the like while an increasein the communication amount, which is requested for uploading data(imaging data) for reproducing images inside and outside the vehicle tothe portable terminal 30, between the in-vehicle device 200 and thecenter server 10 is suppressed. In addition, it is possible toeffectively utilize communication resources by suppressing the increasein the communication amount between the in-vehicle device 200 and thecenter server 10.

In addition, it is possible to suppress an increase in a communicationamount requested for downloading to the portable terminal 30 from acellular phone base station or the like communicating with the portableterminal 30. Accordingly, it is possible to suppress an increase in apacket use amount in the portable terminal 30 and to effectively utilizethe communication resources.

An information processing program according to the embodiment causes acomputer to execute a step of requesting transmission of imaging datacaptured by an imaging apparatus when a predetermined request signal isreceived from a user terminal of a user of a vehicle including theimaging apparatus, and a step of transmitting the imaging data receivedfrom the vehicle in response to the request to the user terminal.Accordingly, it is possible to suppress uploading of imaging data havinga large data capacity to the center server 10 without additionalsignificant improvement of the existing center server 10.

The configuration described in the above embodiment shows an example ofthe contents of the disclosure and can be combined with another knowntechnique. It is also possible to omit or change a part of theconfiguration within a scope not departing from the gist of thedisclosure.

What is claimed is:
 1. An information processing apparatus communicablewith a vehicle including an imaging apparatus and a user terminal of auser of the vehicle, the apparatus comprising: a data transmissionrequest unit configured to request the vehicle to transmit imaging datacaptured by the imaging apparatus when a predetermined request signal isreceived from the user terminal; and a data transmission unit configuredto transmit the imaging data received from the vehicle in response tothe request to the user terminal.
 2. An information processing systemcomprising: the information processing apparatus according to claim 1;and a current shutdown unit which is provided in the vehicle andconfigured to shut down current supply from an auxiliary battery to theimaging apparatus from when ignition off of the vehicle is detecteduntil the request signal is received.
 3. An information processingsystem comprising: the information processing apparatus according toclaim 1; and an operation stop unit which is provided in the vehicle andconfigured to stop an operation of the imaging apparatus when a chargingstate of an auxiliary battery that supplies a current to the imagingapparatus becomes less than a predetermined threshold value from whenignition off of the vehicle is detected until the request signal isreceived.
 4. An information processing program for causing a computer toexecute the steps of: requesting transmission of imaging data capturedby an imaging apparatus when a predetermined request signal is receivedfrom a user terminal of a user of a vehicle including the imagingapparatus; and transmitting the imaging data received from the vehiclein response to the request to the user terminal.